Filter mounting methods and apparatus and related camera apparatus

ABSTRACT

Methods and apparatus, for mounting and using a filter over an image sensor are described as well as camera modules and apparatus incorporating the filter mount. Also described is a sensor and filter assembly which can be formed by combining the sensor, filter, filter mount, and a mounting board which can be shipped and integrated into a camera module and/or camera. A filter is placed in a filter well of a filter mount. By using a well to support the filter over a sensor, the top of the filter can be level or below the top of sidewalls of the filter mount. Use of a well to mount the filter reduces the risk of stray or unintentionally reflected light reaching the sensor and degrading captured images while protecting the filter from downward pressure or sideways contact.

RELATED APPLICATIONS

The present application claims the benefit of U.S. ProvisionalApplication Ser. No. 62/151,403 filed Apr. 22, 2015 which is herebyexpressly incorporated by reference in its entirety.

FIELD

The present application relates to filter mounting methods andapparatus, camera apparatus including a filter mount and camera devicesincluding filter mounts.

BACKGROUND

Camera modules normally each include a sensor. In order to shield asensor intended to capture visible images from the effects of lightwhich is not to be captured by the sensor, e.g., infrared light in thecase of a sensor to be used to capture visual images, a sensor is oftencovered by a filter. Positioning of a filter over a sensor can presentvarious mounting issues.

While an approach to mounting an IR filter over an image sensor is shownin FIG. 1. FIG. 1 shows a filter sensor assembly 1000 which includes anIR filter 1002 which is placed above and glued to supports 1004, 1006.The supports 1004, 1004′ are secured to mounting board 1008 on which thesensor 1003 is mounted. Wires 1006, 1006′ connect the sensor toelectrical contacts, e.g., on the mounting board 1008.

While the IR filter mounting arrangement shown in FIG. 1 is simple toconstruct, it has several disadvantages. The IR filter 1002, because itsits on top of the support walls 1004, 1004′, is subject to the risk ofbeing scratched or crushed during shipment since it is the top mostelement of the assembly 1000. Furthermore light passing through thefilter may bounce off one of the wires 1006 and 1006′ and be reflectedonto the active area of the sensor 1008 since the sidewalls are verticaland the area over the wires 1006 is exposed to light which can bereflected onto the sensor 1003. In additional light may pass through theside of the IR filter and be reflected or otherwise reach the sensorsince the sidewalls of the IR filter 1002 are exposed.

In addition to the above problems the assembly may suffer from issuesrelating to the use of glue between the bottom of the IR filter and thetop of the supports 1004, 1004′ to secure the IR filter to the supports.Glue placed on top of the supports 1004, 1004′ may tend to ooze out whenthe filter 1002 is placed over the supports potentially seeping onto thesensor and/or inner surface of the IF filter and potentially interferingwith light passing through the filter onto the sensor. In addition, afair amount of glue may be needed to prevent the IR filter being shiftedsideways during shipment since the sides of the IR filter may be subjectto sideways forces since they are exposed on top of the supports 1004,1004′.

In view of the above, it should be appreciated that there is a need forimproved methods and apparatus for mounting a filter over an imagesensor and/or for implementing a system including a filter and sensor.While it is not necessary that all embodiments address all of theproblems noted above with the filter mounting arrangement shown in FIG.1, it would be desirable if a filter mounting arrangement and/or filterand sensor assembly could be developed which would address one or moreof the above discussed problems.

SUMMARY

Methods and apparatus, for mounting and using a filter, e.g., an IRfilter, over an image sensor are described as well as camera modules andapparatus incorporating the filter mount. Also described is a sensor andfilter assembly which can be formed by combining the sensor, filter,filter mount, and a mounting board which can be shipped and integratedinto a camera module and/or camera.

In accordance with one aspect, a filter, e.g., IR filter, is placed in afilter well of a filter mount. By using a well to support the filterover a sensor, the top of the filter can be level or below the top ofsidewalls of the filter mount. This decreases the risk of damage to thefilter from downward pressure or sideways contact which could be aproblem if the filter were secured on top of a filter support ratherthan in a well. In addition use of a well to mount the filter reducesthe risk of stray or unintentionally reflected light reaching the sensorand degrading captured images.

In some embodiments the filter well includes notches in the cornerswhere glue can be used to secure the filter in the well. The notchesserver to reduce the potential for stress cracks and also provide anarea where the glue can flow or expand outward without causing problemswith the filter glued in place.

The sidewalls of the filter well protect the filter from lateral forcesallowing a smaller amount of glue to be used to secure the filter thanif the filter was not placed in a filter well with protecting sidewall.Without a well with protecting sidewalls, the filter might, duringshipment, be exposed and subjected to sideways pressure or contactacross the top of the filter that might tend to shift the filter.

The corner notches provide an area where excess glue can ooze out to theside without contaminating the filter surface where light is to pass toreach the sensor located below the filter secured in the filter well. Insome embodiments, sidewalls of the filter support structure which extendup to the bottom of the filter well are tapered rather than beingdirectly vertical. This sidewall tapering reduces the risk of light raysbeing reflected off the inner sidewalls of the filter support and ontothe light sensitive area of the sensor located beneath the filter.

Furthermore by having a portion of the filter mount extend out over thewires which connect the sensor to the mounting board the risk of lightbeing reflected off the wires and onto the sensor is reduced.

The filter support and sensor may be, and in some embodiments are,secured to mounting board, e.g., printed circuit board, with wiresand/or a flexible printed circuit connecting to the sensor and exitingthrough the rear of the printed circuit board which serves as themounting board. Corner cut outs in one or more of the corners of thefilter mount are left open to allow for out gassing as adhesive used tocure the components together into an assembly is allowed to cure and toallow for pressure equalization between the compartment, formed by themounting board, filter mount and filter, in which the sensor is located,and outside atmospheric pressure which may change due to changes inaltitude, e.g., during shipment or use, or because of weather changes.While one or more corners maybe left open to allow for out gassingand/or to avoid pressure differentials which might occur if the unit wascompletely sealed the openings, e.g., e.g. vents, are relatively smallwith little risk of particles reaching and collecting on the sensorsurface. Thus by assembling the filter, mount, sensor and sensor boardin a relatively clean environment, the enclosure formed by the mountingboard, filter holder and filter tend to protect the sensor from dirtduring shipment and subsequent integration into a camera deviceincluding one or more optical chains each including a sensor, filter,filter mount and sensor mounting board.

The assembly including the filter, sensor, filter mount and mountingboard can be assembled and shipped as a unit for integration into acamera module and/or incorporation into a camera including one or moresuch assemblies. Since the sensor is protected by the filter, filtermounting board and support board, it can be shipped and integrated intoa camera module or camera without having to take clean room typeprecautions normally used when dealing with an exposed sensor.Furthermore the filter mount and filter provide a rugged structure whichis less prone to scratching than other configurations where the filteris placed on top of support walls of a filter mount and left exposedabove the level of the support walls. This is particularly the case inembodiments where the filter surface is recessed slightly below the topof the filter mount support walls.

The filter mount and the sensor assembly including the filter mount canbe implemented in a relatively thin format allowing for thin cameraimplementations which can be important given the desire by manycustomers for thin easy to handle devices.

Numerous benefits and embodiments are discussed in the detaileddescription which follows.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 illustrates a way of mounting a filter over an image sensor whichsuffers from various disadvantages as compared to the filter mount andmounting arrangement shown in FIG. 5.

FIG. 2 is a block diagram of an exemplary apparatus, e.g., a cameradevice, implemented in accordance with one embodiment of the presentinvention.

FIG. 3 illustrates an arrangement of optical chains, e.g., cameramodules, used in one embodiment to implement a camera device, such asthe camera device of FIG. 2, where each optical can and sometimes doinclude a fitter, sensor and mount of the type shown in one or more ofthe subsequent figures.

FIG. 4 shows how different camera modules of a camera including multiplecamera modules, e.g. optical chains, such as the one shown in FIG. 3 maycapture different portions of the scene area of interest.

FIG. 5 is a first top perspective view of an assembly including a filterholder, e.g., filter mount, implemented in accordance with one exemplaryembodiment that can be used in the camera modules of a camera devicesuch as the one shown in FIG. 2 or any of the other figures of thepresent application.

FIG. 6 shows the exemplary assembly of FIG. 5 from one perspectiveand/or with a cross sections being shown.

FIG. 7 shows the exemplary assembly of FIG. 5 from another perspectiveand/or with a different cross sections being shown.

FIG. 8 shows the exemplary assembly of FIG. 5 from yet anotherperspective and/or with a different cross sections being shown.

FIG. 9 shows the exemplary assembly of FIG. 5 from still anotherperspective and/or with a different cross sections being shown.

FIG. 10 shows a cross section of an exemplary filter mount, e.g.,holder, which is the same or similar to the filter mount of the assemblyshown in FIG. 5.

DETAILED DESCRIPTION

FIG. 2 illustrates an exemplary camera device 100 such as a digitalcamera, notepad with camera functionality, or cell phone with camerafunctionality, implemented in accordance with one exemplary embodimentof the present invention. The camera device 100, in some embodiments, isa portable device. In other embodiments, the camera device 100 is afixed device such as a wall mounted camera.

FIG. 2 illustrates the camera device 100 in block diagram form showingthe connections between various elements of the apparatus 100. Theexemplary camera device 100 includes a display device 102, a lightemitter 104, an input device 106, an input state detection module 148,an exposure and readout controller 150, e.g., a rolling shuttercontroller 150, a light control device 152, memory 108, a processor 110,an assembly of hardware devices 180, a wireless and/or wired interface114, e.g., a cellular interface, a Wi-Fi interface, and/or a USBinterface, an I/O interface 112, an accelerometer assembly 122, 3 axisgyro assembly 192, and a bus 116 which are mounted in a housingrepresented by the rectangular box touched by the line leading toreference number 100. The light emitter 104 includes light emittingelements which may be LEDs (Light Emitting Diodes) or other types oflight emitting elements which can be individually controlled so that allthe light emitting elements need not be on at the same time. The inputdevice 106 may be, and in some embodiments is, e.g., keypad, touchscreen, or similar device that may be used for inputting information,data and/or instructions. The accelerometer assembly 122 includesaccelerometer 1 124, accelerometer 2 126, and accelerometer 3 128 whichare arrayed on perpendicular axes providing a 3 axis accelerometerassembly. Thus, the accelerometer assembly 122 can measure along 3independent axes.

Similarly, the 3-axis gyro assembly 192, which includes gyro 1 194, gyro2 196 and gyro 198 can measure rotation along each of 3 different axes.The output of the accelerometer assembly 122 and the gyro assembly 192can, and in some embodiments is, monitored with changes in accelerometerand gyro output being interpreted and checked over time by processor 110and/or zoom control module, e.g., zoom controller 140, to detect changesin acceleration indicating motion in one or more directions. In someembodiments the input device 106 includes at least one zoom controlbutton that can be used to enable or disable camera zoom functionality.In some such embodiments when the zoom control button is in a depressedstate the camera zoom function is enabled while when the button is in aun-depressed state the camera zoom function is disabled. The input statedetection module 148 is configured to detect the state of the inputdevice, e.g., the zoom control button, to detect whether the button isin a depressed state or undepressed state. In some embodiments there isa status register in the camera device 100 that includes a bitindicating the state of the zoom control button detected by the statedetection module 148, e.g., whether it is in the depressed stateindicating that zoom is enabled or whether it is undepressed indicatingthat zoom is disabled.

The display device 102 may be, and in some embodiments is, a touchscreen, used to display images, video, information regarding theconfiguration of the camera device, and/or status of data processingbeing performed on the camera device. In the case where the displaydevice 102 is a touch screen, the display device 102 serves as anadditional input device and/or as an alternative to the separate inputdevice, e.g., buttons, 106. As will be discussed in some embodimentszooming operation can be controlled by pressing a zoom control sensor,e.g., a touch sensor. In some embodiments when the camera user touchesthe zoom control sensor the zoom functionality is enabled. For example afinger on the touch sensor activates/enables the zoom functionality. TheI/O interface 112 couples the display 102 and input device 106 to thebus 116 and interfaces between the display 102, input device 106 and theother elements of the camera which can communicate and interact via thebus 116.

In addition to being coupled to the I/O interface 112, the bus 116 iscoupled to the memory 108, processor 110, an optional autofocuscontroller 132, the wireless and/or wired interface 114, a zoom controlmodule 140, and a plurality of optical chains 130, e.g., X opticalchains also referred to herein as camera modules. In some embodiments Xis an integer greater than 2, e.g., 3, 4, 7 or a larger value dependingon the particular embodiment. The plurality of camera modules 130 may beimplemented using any of the various camera module sets and/orarrangements described in the present application. For example, in someembodiments the camera device 100 is implemented using a set of cameramodules as shown in FIG. 3 while in other embodiments the camera device100 may be implemented using other module arrangements. Images capturedby individual optical chains in the plurality of optical chains 130 can,and in various embodiments are, stored in memory 108, e.g., as part ofthe data/information 120 and processed by the processor 110, e.g., togenerate one or more composite images.

The X camera modules 131 through 133 may, and in various embodiments do,include camera modules having different focal lengths. Each cameramodule (camera module 1 131, . . . , camera module X 133) includes animage sensor (sensor 1 127, . . . , sensor X 139), respectively.Multiple camera modules may be provided at a given focal length. Forexample, multiple camera modules having a 35 mm equivalent focal lengthto a full frame DSLR camera, multiple camera modules having a 70 mmequivalent focal length to a full frame DSLR camera and multiple cameramodules having a 140 mm equivalent focal length to a full frame DSLRcamera are included in an individual camera device in some embodiments.The various focal lengths are exemplary and a wide variety of cameramodules with different focal lengths may be used. The camera device 100is to be considered exemplary. To the extent that other references aremade to a camera or camera device with regard to some of the otherfigures, it is to be understood that at least in some embodiments thecamera device or camera will include the elements shown in FIG. 2 evenif the elements are not shown in a particular figure or embodiment.While in some embodiments all of the elements shown in FIG. 2 areincluded in the camera device or camera, in other embodiments a subsetof the elements shown in FIG. 2 are included and the illustration of theelements in FIG. 2 is not intended to imply that a particular element isessential or necessary in all embodiments.

As will be discussed below images from different camera modules capturedat the same time or during a given time period can be combined togenerate a composite image, e.g., an image having better resolution,frequency content and/or light range than an individual image capturedby a single one of the camera modules 131, 133.

Multiple captured images and/or composite images may, and in someembodiments are, processed to form video, e.g., a series of imagescorresponding to a period of time. The interface 114 couples theinternal components of the camera device 100 to an external network,e.g., the Internet, and/or one or more other devices e.g., a memorydevice or stand alone computer. Via interface 114 the camera device 100can and does output data, e.g., captured images, generated compositeimages, and/or generated video. The output may be to a network or toanother external device for processing, storage and/or to be shared. Thecaptured image data, generated composite images and/or video can beprovided as input data to another device for further processing and/orsent for storage, e.g., in external memory, an external device or in anetwork.

The interface 114 of the camera device 100 may be, and in some instancesis, coupled to a computer so that image data may be processed on theexternal computer. In some embodiments the external computer has ahigher computational processing capability than the camera device 100which allows for more computationally complex image processing of theimage data outputted to occur on the external computer. The interface114 also allows data, information and instructions to be supplied to thecamera device 100 from one or more networks and/or other externaldevices such as a computer or memory for storage and/or processing onthe camera device 100. For example, background images may be supplied tothe camera device to be combined by the camera processor 110 with one ormore images captured by the camera device 100. Instructions and/or dataupdates can be loaded onto the camera via interface 114 and stored inmemory 108. The light emitter module 104 in some embodiments includes aplurality of light emitting elements, e.g., LEDs, which can beilluminated in a controlled manner to serve as the camera flash with theLEDs being controlled in groups or individually, e.g., in a synchronizedmanner based on operation of the rolling shutter and/or the exposuretime. For purposes of discussion module 104 will be referred to as anLED module since in the exemplary embodiment LEDs are used as the lightemitting devices but as discussed above the invention is not limited toLED embodiments and other light emitting sources may be used as well. Insome embodiments the LED module 104 includes an array of light emittingelements, e.g., LEDs. In some embodiments the light emitting elements inthe LED module 104 are arranged such that each individual LED and/or agroup of LEDs can be illuminated in a synchronized manner with rollingshutter operation. Light emitting elements are illuminated, in some butnot all embodiments, sequentially, so that different portions of an areaare illuminated at different times so that the full area need not beconsistently lighted during image capture. While all lighting elementsare not kept on for the full duration of an image capture operationinvolving the reading out of the full set of pixel elements of a sensor,the portion of area which is having its image captured, e.g., the scanarea, at a given time as a result of the use of a rolling shutter willbe illuminated thanks to synchronization of the lighting of lightemitting elements with rolling shutter operation. Thus, various lightemitting elements are controlled to illuminate at different times insome embodiments based on the exposure time and which portion of asensor will be used to capture a portion of an image at a given time. Insome embodiments the light emitting elements in the light emitter 104include a plurality of sets of light emitting elements, each set oflight emitting elements corresponding to a different image area which itilluminates and which is captured by a different portion of the imagesensor. Lenses may be, and in some embodiments are, used to direct thelight from different light emitting elements to different scene areaswhich will be captured by the camera through the use of one or morecamera modules.

The rolling shutter controller 150 is an electronic shutter thatcontrols reading out of different portions of one or more image sensorsat different times. Each image sensor is read one row of pixel values ata time and the various rows are read in order. As will be discussedbelow, the reading out of images captured by different sensors iscontrolled in some embodiments so that the sensors capture a scene areaof interest, also sometimes referred to as an image area of interest, ina synchronized manner with multiple sensors capturing the same imagearea at the same time in some embodiments.

While an electronic rolling shutter is used in most of the embodiments,a mechanical rolling shutter may be used in some embodiments.

The light control device 152 is configured to control light emittingelements (e.g., included in the light emitter 104) in a synchronizedmanner with the operation of the rolling shutter controller 150. In someembodiments the light control device 152 is configured to controldifferent sets of light emitting elements in the array to emit light atdifferent times in a manner that is synchronized with the timing of therolling shutter 150. In some embodiments the light control device 152 isconfigured to control a first set of light emitting elementscorresponding to a first image area to output light during a first timeperiod, the first time period being determined based on the timing ofthe rolling shutter and being a period of time during which a firstportion of the sensor is exposed for image capture. In some embodimentsthe light control device 152 is further configured to control a secondset of light emitting elements corresponding to a second image area tooutput light during a second time period, the second time period beingdetermined based on the timing of the rolling shutter and being a periodof time during which a second portion of the sensor is exposed for imagecapture. In some embodiments the first time period includes at least aportion of time which does not overlap the second time period.

In some embodiments the light control device 152 is further configuredto control an Nth set of light emitting elements corresponding to an Nthimage area to output light during a third time period, said Nth timeperiod being determined based on the timing of the rolling shutter andbeing a period of time during which an Nth portion of the sensor isexposed for image capture, N being an integer value corresponding to thetotal number of time periods used by said rolling shutter to completeone full read out of total image area.

In some embodiments the light control device 152 is further configuredto control the second set of light emitting elements to be off duringsaid portion of time included in the first period of time which does notoverlap said second period of time. In some embodiments the lightcontrol device is configured to determine when the first set and saidsecond set of light emitting elements are to be on based on an exposuresetting. In some embodiments the light control device is configured todetermine when said first set and said second set of light emittingelements are to be on based on an amount of time between read outs ofdifferent portions of said sensor. In some embodiments the differentsets of light emitting elements in the plurality of light emittingelements are covered with different lenses. In some such embodiments thelight control device 152 is further configured to determine which setsof light emitting elements to use based on an effective focal lengthsetting being used by the camera device.

The accelerometer assembly 122 includes a plurality of accelerometersincluding accelerometer 1 124, accelerometer 2 126, and accelerometer3128. Each of the accelerometers is configured to detect cameraacceleration in a given direction. Although three accelerometers 124,126 and 128 are shown included in the accelerometer assembly 122 itshould be appreciated that in some embodiments more than threeaccelerometers can be used. Similarly the gyro assembly 192 includes 3gyros, gyro 1 194, gyro 2 196 and gyro 3 198, one for each axis which iswell suited for use in the 3 dimensional real world environments inwhich camera devices are normally used. The camera acceleration detectedby an accelerometer in a given direction is monitored. Accelerationand/or changes in acceleration, and rotation indicative of cameramotion, are monitored and processed to detect one or more directions, ofmotion e.g., forward camera motion, backward camera motion, etc. Asdiscussed below, the acceleration/rotation indicative of camera motioncan be used to control zoom operations and/or be provided in some casesto a camera mount which can then take actions such as rotating a cameramount or rotating a camera support to help stabilize the camera.

The camera device 100 may include, and in some embodiments does include,an autofocus controller 132 and/or autofocus drive assembly 134. Theautofocus drive assembly 134 is, in some embodiments, implemented as alens drive. The autofocus controller 132 is present in at least someautofocus embodiments but would be omitted in fixed focus embodiments.The autofocus controller 132 controls adjustment of at least one lensposition in one or more optical chains used to achieve a desired, e.g.,user indicated, focus. In the case where individual drive assemblies areincluded in each optical chain, the autofocus controller 132 may drivethe autofocus drive of various optical chains to focus on the sametarget.

The zoom control module 140 is configured to perform a zoom operation inresponse to user input. The processor 110 controls operation of thecamera device 100 to control the elements of the camera device 100 toimplement the steps of the methods described herein. The processor 110may be a dedicated processor that is preconfigured to implement themethods of the present invention. However, in many embodiments theprocessor 110 operates under direction of software modules and/orroutines stored in the memory 108 which include instructions that, whenexecuted, cause the processor 110 to control the camera device 100 toimplement one, more or all of the methods described herein. Memory 108includes an assembly of modules 118 wherein one or more modules includeone or more software routines, e.g., machine executable instructions,for implementing the image capture, image generation and/or image dataprocessing methods of the present invention. Individual steps and/orlines of code in the modules of 118 when executed by the processor 110control the processor 110 to perform steps of the method of theinvention, e.g., generating depth map, determining maximum expectedfrequencies and/or filtering image portions, in accordance with theinvention. When executed by processor 110, the assembly of modules 118cause at least some data to be processed by the processor 110 inaccordance with the method of the present invention, e.g., filteringimage portions in accordance with the invention. The assembly of modules118 includes a mode control module which determines, e.g., based on userinput which of a plurality of camera device modes of operation are to beimplemented. In different modes of operation, different camera modules131, 133 may be, and often are, controlled differently based on theselected mode of operation. For example, depending on the mode ofoperation different camera modules may use different exposure times.Alternatively, the scene area to which an individual camera module isdirected and thus what portion of a scene is captured by the individualcamera module may be changed depending on how the images captured bydifferent camera modules are to be used, e.g., combined to form acomposite image and what portions of a larger scene individual cameramodules are to capture during the user selected or automaticallyselected mode of operation. In some embodiments, the operationsperformed by the processor 110 when executing the instructions from oneor more assembly of modules of the assembly of modules 118 is insteadperformed by a hardware device which performs the same functionality andis included in the assembly of hardware devices 180.

The resulting data and information (e.g., captured images of a scene,combined or composite images of a scene, filtered images, etc.) arestored in data/information block 120 for future use, additionalprocessing, and/or output, e.g., to display device 102 for display or toanother device for transmission, processing and/or display. In someembodiments the data/information block 120 further includes opticalchain information, e.g., optical characteristics, corresponding to theplurality of optical chains 130 in the device 100. If one or moreparameters/settings in the optical characteristics of a camera modulechanges then the corresponding optical chain information stored in thedata/information 120 is updated. The memory 108 includes different typesof memory for example, Random Access Memory (RAM) in which the assemblyof modules 118 and data/information 120 may be, and in some embodimentsare stored for future use. Read only Memory (ROM) in which the assemblyof modules 118 may be stored for power failures. Non-volatile memorysuch as flash memory for storage of data, information and instructionsmay also be used to implement memory 108. Memory cards may be added tothe device to provide additional memory for storing data (e.g., imagesand video) and/or instructions such as programming. Accordingly, memory108 may be implemented using any of a wide variety of non-transitorycomputer or machine readable mediums which serve as storage devices.

As shown in FIG. 3 seventeen camera modules are used in a single cameradevice, e.g., camera device 100 of FIG. 2, in some embodiments. Cameradevices including even larger numbers of optical chains are alsopossible.

The use of multiple optical chains has several advantages over the useof a single optical chain. Using multiple optical chains allows fornoise averaging. For example, given the small sensor size there is arandom probability that one optical chain may detect a different number,e.g., one or more, photons than another optical chain. This mayrepresent noise as opposed to actual human perceivable variations in theimage being sensed. By averaging the sensed pixel values correspondingto a portion of an image, sensed by different optical chains, the randomnoise may be averaged resulting in a more accurate and pleasingrepresentation of an image or scene than if the output of a singleoptical chain was used.

Given the small size of the optical sensors (e.g., individual pixelelements) the dynamic range, in terms of light sensitivity, is normallylimited with the sensors becoming easily saturated under brightconditions. By using multiple optical chains corresponding to differentexposure times, the dark portions of a scene area can be sensed by thesensor corresponding to the longer exposure time while the lightportions of a scene area can be sensed by the optical chain with theshorter exposure time without getting saturated. Pixel sensors of theoptical chains that become saturated as indicated by a pixel valueindicative of sensor saturation can be ignored, and the pixel value fromthe other, e.g., less exposed, optical chain can be used withoutcontribution from the saturated pixel sensor of the other optical chain.Weighting and combining of non-saturated pixel values as a function ofexposure time is used in some embodiments. By combining the output ofsensors with different exposure times a greater dynamic range can becovered than would be possible using a single sensor and exposure time.

FIG. 3 is a diagram 1200 showing how the 17 optical chains, e.g., cameramodules, of a camera, e.g., the camera device of FIG. 2, can be arrangedwithin the body of the camera. Each of the camera modules, e.g., opticalchains, may include a sensor, filter mount and filter of the type shownin FIG. 5. In one exemplary embodiment, the camera shown in FIG. 3 iscamera 100 of FIG. 2 and each of the 17 optical chains shown in FIG. 3is one of the X camera modules (131, . . . , 133), where X=17. The sevenoptical chains 1202, 1206, 1210, 1212, 1216 1220, 1222 with the largestlenses and largest supported focal lengths are implemented using opticalchains of a first type, e.g., including a mirror. Similarly, the fivecamera modules 1204, 1208, 1214, 1218, 1224 with the medium diameterlenses and medium supported focal lengths are also implemented usingoptical chains of the first type. The five optical chains 1226, 1228,1230, 1232 and 1234 having the smallest diameter outer openings, e.g.,light entrance openings, and smallest focal lengths are implementedusing optical chains which do not use mirrors and extend straight towardthe back of the camera. From the FIG. 3 example which may be consideredas a frontal view with the front of the camera housing removed to allowviewing of the camera modules, it can be seen how a larger number ofcamera modules can be incorporated into a single camera device allowingfor the simultaneous and/or synchronized capture of multiple images ofthe same or different portions of a scene area using a single camera.The camera device can then combine multiple images to generate acomposite image having image attributes and/or qualities such as anumber of pixels which exceeds that possible using a single one of thecamera modules of the camera.

In some embodiments the camera includes a processor (e.g., processor110) configured to generate a composite image by combining at least afirst and a second image. In some embodiments the processor isconfigured to generate the composite image from first, second, third,fourth, fifth and sixth images. In some embodiments the processor isconfigured to generate the composite image from the first, second,third, fourth, fifth, sixth and seventh images. In some embodiments theprocessor is further configured to control storage of the generatedcomposite image in the device memory, e.g., memory 108, and/or output ofthe composite image on a display, e.g., display 102, and/or transmissionof the captured images or the composite image to another device via aninterface such as interface 114.

FIG. 4 is a drawing 900 illustrating an exemplary scene area 802 whichmay have all or portions of its image captured by camera modules of acamera, e.g., the camera 100, implemented in accordance with one or moreembodiments of the invention. Scene area 802 includes multiple objectsat least some of which are stationary while others are in motion. In theexample, the scene area 802 includes an airplane 804, a person 806, aball 807, a tree 808 and a house 810. Each of the objects in the scene802 may have a different corresponding depth in the scene 802. Inaccordance with one aspect, depth information corresponding to the sceneof interest 802 may be generated, e.g., using images corresponding tothe portions of scene of interest captured by one or more camera modulesand/or by using depth measurement equipment. The generated depthinformation, e.g., a 3D depth map, includes depths corresponding to thevarious objects in the scene 802. In the illustrated example, the scenearea 802 may be logically partitioned into various scene portions basedon various depths in the depth map for the scene of interest 802. In theexample consider that there are five different depths in the depth mapcorresponding to the scene of interest 802.

Drawing 900 of FIG. 4 further illustrates conceptually how differentoptical chains, e.g., camera modules, of a camera, such as the cameradevice 100 of FIG. 2 which includes multiple optical chains (as shown inFIG. 3), some of which have different focal lengths can capturedifferent size portions of a scene area 802. The different capture sizescorresponding to the various different camera modules correspond tofield of view (FOV) of the respective camera modules in someembodiments.

For purposes of discussion, the capture and combining of imagescorresponding to different scene areas will be explained using thecamera device 100 by referring to FIG. 3 which shows the arrangement ofoptical chains in camera 100. Consider for purposes of discussion thatthe camera device 100 includes the 17 modules arranged as shown in FIG.3. As previously discussed in the FIG. 3 example, three different focallengths, f1, f2 and f3 are used where f1<f2<f3; f1 is ½ f2; and f2 is ½f3.

For purposes of discussion the first through seventh camera modules1202, 1206, 1210, 1212, 1216 1220, 1222, respectively, are the moduleswith the largest lenses (and thus largest apertures in variousembodiments) and largest supported focal lengths (f3). For simplicity inthe discussion below, it is further assumed that the distances betweenthe various camera modules is much smaller than the distance between thecamera and all the objects in the scene. This is however not alimitation of the described invention but meant only to make theexplanation easier to follow.

The five medium sized camera modules which are the eighth through 12thcamera modules correspond to reference numbers 1204, 1208, 1214, 1218,1224, respectively and have medium diameter lenses and medium supportedfocal lengths (f2).

The five camera modules which are the 13th through 17th camera modulescorrespond to reference numbers 1226, 1228, 1230, 1232 and 1234 and havethe smallest diameter lenses and smallest focal length (f1).

It should be appreciated that the camera modules with the largest focallength f3 will have a relatively smaller field of view in comparison tocamera modules with smaller focal lengths and capture smaller portion ofa scene area of interest given that they provide the greatestmagnification. Assuming that camera modules of the different focallengths use sensors with the same total pixel count, the modules withthe larger focal length (f3) will provide an image with a higher pixelto scene area ratio since more pixels will be used to capture an imageof a smaller scene area than will be the case with the medium (f2) andsmall focal length (f1) camera modules.

It should be appreciated that given the difference in magnificationbetween the modules with different focal lengths (f1, f2, f3) the scenearea captured by the small focal length (f1) camera modules willcorrespond to portion of the scene area of interest which isapproximately 16 times the size of the portion the scene area ofinterest which is captured by the camera modules with the largest (f3)focal length. The portion of the scene area of interest captured bycamera modules with the intermediate focal length (f2) will be 4 timesthe size of the portion of the scene area of interest captured by thecamera modules with the largest focal length (f3) and ¼ the size of theportion of the scene area of interest captured by the camera moduleswith the smallest focal length (f1).

The relationship between the scene areas captured by camera modulescorresponding to the f1 and f2 focal lengths can be appreciated in thecontext of the FIG. 4 example which shows 7 distinct scene areas. Insome embodiments f1=35 mm and f2=70 mm.

In the FIG. 4 example the scene area of interest is identified byreference 802. The scene area 802 corresponds to the full scene area ofinterest. For purposes of explanation consider that the scene area 802is captured by optical chains having the focal length f1, i.e., bysmaller focal length optical chains. Assume for discussion purposes that(f1) camera module 1228 is used to capture the scene area 802represented by the largest rectangle in FIG. 4. Note that the actualimage captured by 1228 may be of a slightly larger scene area to ensurethat the scene area of interest is captured.

Further consider that f2 camera module 1204 is used to capture a secondscene area 902 which is represented by the rectangle in the top leftcorner in FIG. 3, that (f2) camera module 1208 is used to capture athird scene area 904 represented by the rectangle in the top rightcorner in FIG. 3, that (f2) camera module 1218 is used to capture afourth scene area 906 represented by the rectangle in the bottom leftcorner in FIG. 3, that (f2) camera module 1214 is used to capture afifth scene area 908 represented by the rectangle in the bottom rightcorner in FIG. 3 and that (f2) camera module 1224 is used to capturesixth scene area 910 represented by the rectangle with dashed lines inthe center portion. Again as with the capture of the other scene areas,the actual images captured by the modules 1204, 1208, 1218, 1214 and1224 may be of slightly larger scene areas to ensure that the respectivescene areas are fully contained in the captured images.

Note that the relative position of the outer openings of the cameramodules shown in drawing 1200 are known and fixed in some embodiments.However, in some embodiments the modules 1204, 1208, 1218, 1214 and 1224are the same or similar in their elements and function to a module whichincludes a mirror that can be driven, e.g., moved or rotated by thehinge (mirror) drive to change the angle of the mirror. While the mirrordrive can rotate the mirror around the hinge axis and thus change itsangle, the hinge prevents motion in other directions and thus theoptical axis (outside the camera) rotates in a plane perpendicular tothe axis of the hinge. When the mirror is at a 45 degree angle, thelight entering the opening along its optical axis is deflected 90degrees into the optical axis of Part B of the module, where Part B isthe part of the module including optical elements in the light path thatare after the light redirection element.

While some modules use a mirror that is movable and hinged, in otherembodiments one or more of the camera modules are implemented with afixed position mirror allowing the moveable hinge and mirror drive to beomitted.

The mirror/hinge drive is controlled by the processor 110 depending onthe particular mode of camera operation. Thus, when a user selects afirst mode of operation one or more camera modules may have theirmirrors at a first angle while during another mode of operation, e.g., amodule in which images are to captured and combined, one or more cameramodules will have their mirror driven to a different position undercontrol of the processor 110. The particular mode of camera deviceoperation may be determined based on user input by the processor 110operating under control of the mode control module 111 or directly bythe mode control module 111 when the mode control module is implementedin hardware.

If mirrors in each of 1204, 1208, 1218, 1214 and 1224 are at 45 degrees,each module looks directly out of the front face of the camera and theiroptical axes are all parallel. In this case each of the modules willtake an image of the same scene area, e.g., the scene area 910 of FIG.4. To capture an image of the second scene area with module 1204, thehinged mirror of module 1204 is adjusted so that the optical axis ofcamera module 1204 points towards the center of the second scene area906. Note that the module 1204 is positioned in the camera 1200 in sucha manner that as the mirror is rotated/moved relative around the hinge,the location in the scene area of interest 802 that the optical axispoints to moves along the diagonals of the rectangle 802. Similarly, themirror for camera module 1214 is adjusted to capture the fifth scenearea. Note that in FIG. 3, camera modules 1204, 1214 are arrangedproximate, e.g., along or adjacent, one diagonal while camera modules1208, 1218 are located proximate, e.g., along or adjacent, the otherdiagonal. Rotating the mirror in 1214, e.g., changing the angle and thusincline of the mirror, makes the module's optical axis move along thecorresponding diagonal. Mirrors of modules 1208 and 1218 are similarlyangled, e.g., rotated, to capture images of the other scene areasrespectively. The module 1224 used to capture the sixth image area 910points at the center of the scene area of interest 802 so its mirror ismaintained at 45 degrees.

It should be appreciated from the above discussion that some cameramodules arranged along diagonals. These modules have the Part B of theiroptical axis parallel to one of the two diagonals. Thus, the arrangementof modules 1210, 1220, 1202, 1212 with the largest apertures alongdiagonals and also the arrangement of medium aperture modules 1204,1214, 1208, 1218 along the same diagonals but offset from the othermodules for space reasons, is an intentional design choice because itfacilitates image capture and combining in some embodiments and modes ofoperation.

Based on the overlapping scene areas, e.g., 910 and 904 a depth map isgenerated, e.g., by the processor included in the camera in someembodiments. In some embodiments the depth of an object in the scene canbe determined by examining the relative positions of an object in theimages captured by different modules. In at least some embodiments thedepth map is used, e.g., in combination with information about therelative position of the outer opening of the different optical chainsand/or optical axis of the optical chains in combining images capturedby the different optical chains to form a composite image.

In the FIG. 4 example, 6 distinct scene areas are shown for purposes ofexplaining the invention. Each of the 6 scene areas may be, and in someembodiments is, captured by a different optical chain of the cameradevice 100 prior to being combined.

It should be appreciated that by combining images corresponding to thedifferent scene area portions shown in FIG. 4 to generate a compositeimage, it is possible to generate a composite image with four times thepixel count of a single image sensor. For example, if each of the imageportions is captured by a camera module using an 8 mega pixel sensor,the composite image corresponding to the scene area of interest shown inFIG. 4 would have an overall pixel count of 32 megapixels since thesecond, third, fourth and fifth scene area would each be captured by adifferent 8 megapixel sensor and thus contribute 8 megapixels to thecomposite image. The actual resolution could be slightly lower if thecaptured images are slightly larger than the corresponding scene areas.

FIG. 4 and the image portions, e.g., the scene areas, shown therein willbe used in explaining how rolling shutters corresponding to differentcamera modules can be controlled in a coordinated manner to facilitatecombining of images captured by different camera modules in a way thatreduces or minimizes motion related (camera or subject related)distortions that may be introduced if each of the camera module sensorswere independently (asynchronously) operated to capture the imageportions. The read out from the sensors of the camera modules in acoordinated manner helps in minimizing distortions due to uncoordinatedasynchronous image capturing by different optical chains and thecaptured images can be combined easily.

The above discussed image capture operations performed by varioussensors included in corresponding optical chains as discussed above may,and in some embodiments is, performed by a camera such as camera 100including optical chains arranged as illustrated in FIG. 3.

FIG. 5 is a first top perspective view of an assembly 1100 including afilter mount, e.g., holder, 1106 implemented in accordance with oneexemplary embodiment, which is secured to a mounting board 1102 throughwhich a flexible printed circuit (FPC) 1107 makes electrical contactwith an image sensor 1307 (see FIG. 6) secured to the mounting board1102 and over which the filter mount 1106 is positioned. A filter 1114,e.g., IR filter, is shown in a filter well generally indicated byreference 1110 with the filter 1114 sitting on a support ledge 1111.While the invention will be explained with reference to an IR filter itshould be appreciated that other filters maybe mounted in the filtermount 1106 instead, e.g., a color filter, and thus an IR filter ismerely exemplary. The filter 1114 may have a thin flat rectangularshape.

The IR filter 1114, in some embodiments has a thickness slightly lessthan the depth of the filter well 1110. In the FIG. 5 example the IRfilter 1114 has slightly rounded corner edges to reduce the potentialfor stress at the corners and thus reduce the potential for stresscracks radiating from the corner of the IR filter 1114. Since the IFfilter is slightly thinner than the filter well 1110 is deep in someembodiments, should a flat object be placed on the top of the filterwell it will not contact the surface of the IR filter 1114 and the waitof the object will be supported by the sidewalls 1309, 1309′ of thefilter well. Inner sidewalls 1306, 1306′ (see FIG. 7) extend outwardfrom the outer sidewalls 1309, 1309′ to form a support ledge 1111. Whilethe inner sidewalls 1309, 1309′ extend inward to from the support ledge1311 as they extend upward they are tapered so that the top portion ofthe inner sidewalls is located further out over the sensor than thebottom portion of the inner sidewall 1309, 1309′.

Thus while the filter 1114 maybe the same as or similar to the IR filter1002, but of a size and shape that to fit in the filter well 1110, insome embodiments the IR filter 1114 is thinner than IR filters mountedon top of support walls and exposed to loads. This is because the IRfilter 1114 need not be designed to support direct loads which will besupported by the top of the filter support walls instead of by thefilter surface particularly in embodiments where the IF filter 1114 isthinner than the well in which the filter 1114 is mounted is deep.

Since the sides of the IR filter 1114 are blocked by the sidewalls 1309,1309′ of the filter well 1110, the chance of light entering through theside of the IF filter 1114 and being directed down towards the sensor1307 located beneath the IR filter 1114 by internal reflections and/or adirect light path is reduced or avoided.

In some embodiments the filter well 1110 includes round corner notches1112, 1112′, 1112″ and 1112′″. Such rounded corners reduce or avoidpotential stress points that might occur if the corners came to a sharpright angle. The rounded corners also provide an area into which a dropof glue used to secure the IR filter 1114 to the filter support canspread or expand without reaching the area over the active area of thesensor 1307. The center area 1116 of the IR filter 1114 shown in FIG. 5represents the active area of a sensor 1307 positioned beneath the IRfilter 1114. FIG. 1118 represents an image of a scene, e.g., person,which may be captured by the image sensor 1307 located beneath thefilter 1114. Orientation marker F 1104 is included on the mounting board1102 and can facilitate an appreciation of the different views of theassembly which can be seen in FIGS. 6 through 9. Electrical components1140 and 1142 are shown mounted to the printed circuit board 1102 alongwith the filter holder 1106. Depending on the embodiment the top surfaceof the IR filter 1114 is level with or slightly below the top surface1106 of the filter holder 1106.

In the FIG. 5 embodiment the filter mount 1106 includes two notchedcorners 1122, 1124 which allow for out gassing, e.g., of glue fumes,and/or pressure equalization between the cavity 1357 and the exteriorenvironment. The cavity 1357 is formed by the inside of the filter mounthousing 1106 which encloses the sensor 1307 that is secured to theprinted circuit board which is used as a mounting board to support thefilter holder 1106 and the sensor 1307 mounted beneath the filter holder1106 on the top side of the mounting board 1102.

One or more corners of the filter holder 1106 may be stepped asindicated by reference numbers 1128, 1120 and 1126 corresponding todifferent corners. Corner 1126 is intentionally left open to allow forventing of a cavity 1357 formed by the filter 1114, filter mount 1106and mounting board 1102. The sensor 1307 is mounted in the cavity 1357.While vented at one or more corners, the vent area is relatively smallminimizing the risk of dust or dirt entering the otherwise sealed cavity1357 in which the sensor 1307 is mounted, e.g., on the surface 1103 ofmounting board 1102.

The steps on the various corners of the filter holder 1106 can be usedto facilitate holding of the filter holder 1106 in a mounting rig duringassembly of the components shown in FIG. 5 and/or for other purposes,e.g., to avoid other components which may be included in a camera moduleinto which the assembly shown in FIG. 5 is to be integrated. Dependingon the camera module into which the assembly shown in FIG. 5 is to beincorporated, the sensor 1307 and filter holder 1106 may be positionedwith a bottom edge parallel to a bottom edge of the mounting board 1102or offset at an angle as shown in FIG. 5.

The assembly shown in FIG. 5 can be constructed and shipped as a unitfor integration into a camera module and/or other camera device. Bysecuring the sensor 1307 to the printed circuit board and covering itwith the filter and filter holder 1106 prior to shipment as an assemblyfor integration into a camera, the sensor 1307 surface can be protectedfrom dust and scratches during shipment and subsequent integration ofthe assembly including the sensor 1307 into a camera. The FPC 1107 canbe used to connect the sensor 1307 output to a processor capable ofprocessing and/or storing images.

The filter holder 1106 may be, and in some embodiments is, glued to thecircuit board 1102 with the image sensor 1307 also being glued orsoldered to the board 1102. The rounded corners 1112, 1112′, 1112″ and1112′″ provide convenient glue positions where a drop of glue can beplaced prior to insertion of the filter 1114 into the filter well 1110.Excess glue can ooze out into the rounder corner recesses without riskof the glue contaminating the bottom surface of the filter areacorresponding to the active region of the image sensor 1307. Since thesidewalls of the filter holder 1309, 1309′ protect the filter 1114 fromlateral forces that might be placed on the filter if it was notsurrounded on the sides by the sidewalls 1309 of the filter well, thefilter 1114 need not be secured around all its edge surfaces and gluingin the corners is sufficient for many embodiments. However, in highlyshock resistant embodiments the filter may be glued around its fullperimeter. The rounding of the corner notches 1112, 1112′ and/or cornersof the filter 1114 reduces the risk that the corners of the filter 1114will be subject to stress which can be important since corners are areasfrom which cracks tend to originate given that they are often prone tostress.

FIG. 10 shows a cross section of the assembly of FIG. 5. In the FIG. 10cross section it can be seen that the internal sidewalls 1306, 1306′ aretapered and angle inward as the inside sidewalls 1306, 1306′ extendupward from the area in contact with or just above the top of the imagesensor 1307 to a support surface 1311 formed by the top of the sidewalls1306, 1306′ which support the filter 1114. The taper reduces the risk ofreflections from the sidewall onto the active area of the sensor ascompared to embodiments where vertical inner sidewalls might be used forthe portion of the filter mount below the mount and above the sensor1307. In FIG. 10, gap 1310 shows the open space surrounding image sensor1307 in which wires are located and secured to contacts on the imagesensor 1307. Filter mount 1106 sidewall cross sections 1304, 1304′ showthe shape of the sidewall of the filter holder 1106 including the outersupport portions 1309 and 1309′ as well as the inner support walls 1306and 1306′ as they extend out from the support wall portions 1309, 1309′of the filter mount to form a support ledge 1111 of the filter well1110. The filter well 1110 is above the sensor 1307 and provides an areain which the IR filter is mounted. During shipment and use the IRfilter, filter mount 1106 and circuit board form a protective cavitywhich houses the sensor 1307 and protects it from damage from dust andpossible damage from infrared light (IR) during shipment and use.

FIGS. 6, 7, 8, and 9 show the exemplary assembly of FIG. 5 from variousperspectives and/or with different cross sections being shown and usingthe same reference numbers as used in FIG. 5. FIG. 6 shows a perspective1250 while FIG. 7 shows a cross section 1300. FIG. 8 shows another crosssection 1400 while FIG. 9 shows cross section 1500. FIG. 10 shows across section 1600 of the filter holder 1106. To avoid repetition likenumbered elements are numbered the same in the various figures and thedescription of the elements will not be repeated with regard to eachfigure for purposes of brevity.

In FIG. 6, the illustrated cross-section 1300 shows a portion of theassembly shown in FIG. 5. The apparatus includes a filter mount 1106including sidewalls 1309, 1309′, 1306, 1306′ forming a filter well 1110for mounting a filter 1114. The sidewalls include outer support walls(309, 1309′ extending from a top surface 1103 of a mounting board 1102to a top 1106′ of the filter well 1110. The top surface 1106′ is alsothe top of the filter well since the top surface 1106′ of the filtermount 1106 defines the top of the filter well 1110. Inner sidewalls1306, 1306′ of the filter mount 1106 extend inward from the outersupport walls 1309, 1309′ to form a support ledge 1111 for supportingthe filter 1114 in the filter well 1110. The filter mount 1106 ispositioned, e.g., secured to a top surface 1103 of said mounting board1102. The filter mount 1106 maybe and sometimes is secured by glue,screws and/or clips. A filter 1114 is positioned in said filter well1110 resting on the top surface of the support ledge 1111. A small gapmay exist between the vertical side of the filter 114 and the verticalsidewalls of the filter well 1110 which extend from the ledge 111 uptowards the top 1106′ of the filter mount 1106. This gap allows forminor thermal expansion of the filter and reduces the risk of stressbeing placed on the sidewalls of the filter 1114 due to differentthermal expansion rates of the filter 1114 and the material, e.g.,plastic, out of which the filter mount 1106 is made. The filter 1114,filter mount 1106 and mounting board 1102 form a cavity 1357 in which asensor 1307 is mounted to the mounting board 1102. Wires which arecovered by the filter mount 1106 including the support ledge 1111connect the sensor 1307 to the mounting board 1102 and/or pass throughthe mounting board 1102 to the flexible circuit tape 1107. The wires 901are not visible in FIG. 6 but one wire represented by a dot on the rightside of the sensor 1307 can be seen in FIG. 7 and multiple such wires901 can be seen in FIG. 9 which shows the sensor 1307 extending out of acut away view of the filter mount 1106.

The filter well 1110 includes rounded notched corners 1112, 1112′ as canbe seen in the figures including FIGS. 6 and 7. In some but notnecessarily all embodiments the filter 1114 includes rounded corners andmaybe in the form of a plate of filter material. The filter 1114 maybethe same or similar to the filter 1002 shown in FIG. 1 but of a sizewhich fits in the filter well 1110.

In some embodiments the filter 1114 is secured to the filter mount 1106in the filter well 1110 by a drop of glue placed in the corners of thefilter well 1110. The notch in the corner provides not only a stressrelief function but also provides an area into which excess glue mayflow away from the active sensor area 1116. In some embodiments thefilter 1114 is not glued at locations other then in the corners. Thisallows for minor movement and/or thermal expansion since the filter 1114is not secured continuously around the entire perimeter. However, inother embodiments where vibration is of concern the glue maybe placedaround the entire filter 1114 securing and sealing the filter to thefilter holder 1106 in the filter well 1110. Thus in some embodiments thefilter 1114 is not glued at locations other than the corner locations,e.g., is not glued in the middle along the edge which extends betweencorners of the filter 1114. In some embodiments the inner sidewalls1306, 1306′ of the filter mount 1106 are tapered as can be seen in FIG.7. The taper reduces the risk of light reflections towards the activearea 1116 of the sensor 1307 which might occur is vertical sidewallswere used and light was to strike the vertical sidewalls and bereflected down towards the active area 1116 of the sensor 1307. Thetaper is used in some but not necessarily all embodiments.

As can be seen in FIG. 7, in the case where taper inner sidewalls areused the tapered inner sidewalls 1036, 1306′ extend further inward atthe top than at the bottom of the sidewalls 1306, 1306′. Note that thistaper in some embodiments exists in all four sidewalls forming thesupport ledge 1111. The longer portion of the sidewalls correspond tothe top of sidewalls 1306, 1306′ on which the filter 1114 is mounted andthe bottom of said sidewalls corresponds to the side which extends overthe sensor 1307 and which extends out less than the top portion of thesupport wall.

As mentioned above but as can be seen more clearly in FIG. 9, thesupport ledge 1111 extends over wires 901 connecting said sensor 1307 tothe mounting board 1102 or a flexible electrical tape 1107.

In some embodiments the filter mount is designed to minimize reflectionsand to block stray light from reaching the active area of sensor 1307 orwires/other components which might reflect stray light onto the activearea of the sensor 1307. To reduce reflections in some embodiments thefilter mount 1106 is a dark color, e.g., black or brown. To furtherreduce the risk of reflections in some embodiments the filter mount 1106includes a flat finish and is made of an opaque material, e.g., plastic,through which light is not likely to pass. Thus in some embodiments thefilter mount 1106 has a matt finish and the filter mount 1106 is made ofa non-reflective material. In some embodiments a top surface of thefilter (1114) is recessed below a top surface of the outer support walls1309, 1309′.

In some embodiments at least one corner, e.g., corner 1126, of saidfilter mount 1106 is open for ventilation of the cavity 1357. In somecases at least two corners are open allowing for cross ventilation.

While one or more corners maybe open, to reduce the risk of dirtentering the cavity 1357 one or more corners are sealed. For examplecorner 1128 of said filter mount 1106 is sealed. In some embodiments twocorners are sealed and two corners are open allowing for a reasonabletradeoff between risk of sensor contamination and still allowing for areasonable amount of venting. Thus in some embodiments multiple cornersof the cavity 1157 are sealed.

As discussed above, stepping of corners can facilitate holding of thefilter mount in an assembly jig facilitating alignment and assembly ofthe filter to other components such as the board 1102 and/or theassembled unit including the filter mount, filter 1114, and sensor 1307into a camera housing. Thus in some embodiments at least one 1828 of thecorners of the filter mount 1106 are stepped. The steps on differentcorners maybe and sometimes are different to reduce the risk of thefilter mount being inserted into the assembly jig in the incorrectposition.

In some embodiment the filter mount 1106, sensor 1307 and filter 1114are combined with various other components to form a camera module. Thecamera module maybe used as any one of the camera modules shown in FIG.3. Thus is should be appreciated that the sensor and filter assembly ofthe invention is well suited for use in camera modules such as module1226 which does not include a mirror as well as camera modules such ascamera modules 1206 and 1208 which include a mirror.

The orientation of the sensor relative to the bottom of the mountingboard 1102 may and in some embodiments does vary for camera moduleswhich include a mirror for direction light onto the sensor with theposition, e.g., angle of the sensor relative to the bottom or top edgeof the board 1102 depending on the final intended orientation of thecamera module in which the sensor will be incorporated in the camera 100with different modules being orientated differently relative to thebottom of the camera 100 as can be seen in FIG. 3.

Thus in some embodiments and features are directed to a camera module1206, 1226, 1208, 1212, etc. for use in a camera device 100 where thecamera module includes a filter 1114, a filter mount 1106 includingsidewalls 1309, 1309′, 1306, 1306′ forming a filter well 1110 formounting the filter 1114, said sidewalls including outer support walls1309, 1309′ extending from a surface 1103 of a mounting board 1102 to atop 1106′ of said filter well 1110, inner sidewalls 1306, 1306′ of saidfilter mount 1106 extending inward from the outer support walls 1309,1309′ to form a support ledge 1111 for supporting the filter 1114 in thefilter well 1110 and a sensor 1307 mounted on the mounting board 1102beneath said filter 1114. The camera modules in some embodiments includea flexible circuit tape 1107 connected to said sensor 1307 by wires 901extending through said mounting board 1102 to said sensor 1307.

Some camera module include a round lens or cover for allowing light toender the camera module as represented by the circles of camera modules1206, 1208, 1226, 1202. Underneath the lens or cover plate cameramodules 1206, 1208, 1202 include a light redirection device, e.g.,mirror, for redirecting light through the filter 1114 and onto thesensor 1307 at the rear of the camera module which includes the lightredirection device. Other modules such as module 1226 includes a lens orcover but no light redirection device and light is allowed to passdirectly through the lens or cover to through the filter 1114 to reachthe sensor 1307 of the camera module. Thus is should be appreciated thethat filter mount 1106 and sensor arrangement can be used in a widevariety of camera modules whether or not a light redirection device isincorporated into the camera module.

FIG. 10 shows a cross section 1600 of an exemplary filter mount 1106,e.g., holder, which is the same or similar to the filter mount 1106 ofthe assembly shown in FIG. 5. The angled inner sidewalls 1306 and 1306′of the filter mount 1106 can be clearly seen in the FIG. 10illustration.

The camera devices of the present invention support multiple modes ofoperation and switching between different modes of operation. Differentmodes may use different numbers of multiple lenses per area, and/ordifferent exposure times for different optical chains used to capture ascene area in parallel. Different exposure modes and filter modes mayalso be supported and switched between, e.g., based on user input.

Numerous additional variations and combinations are possible whileremaining within the scope of the invention.

The techniques of the present invention may be implemented usingsoftware, hardware and/or a combination of software and hardware. Thepresent invention is directed to apparatus, e.g., dedicated cameradevices, cell phones, and/or other devices which include one or morecameras or camera modules. It is also directed to methods, e.g., methodof controlling and/or operating cameras, devices including a camera,camera modules, etc. in accordance with the present invention. Thepresent invention is also directed to machine readable medium, e.g.,ROM, RAM, CDs, hard discs, etc., which include machine readableinstructions for controlling a machine to implement one or more steps inaccordance with the present invention.

In various embodiments devices described herein are implemented usingone or more modules to perform the steps corresponding to one or moremethods of the present invention, for example, control of image captureand/or combining of images. Thus, in some embodiments various featuresof the present invention are implemented using modules. Such modules maybe implemented using software, hardware or a combination of software andhardware. In the case of hardware implementations embodimentsimplemented in hardware may use circuits as part of or all of a module.Alternatively, modules may be implemented in hardware as a combinationof one or more circuits and optical elements such as lenses and/or otherhardware elements. Thus in at least some embodiments one or moremodules, and sometimes all modules, are implemented completely inhardware. Many of the above described methods or method steps can beimplemented using machine executable instructions, such as software,included in a machine readable medium such as a memory device, e.g.,RAM, floppy disk, etc. to control a machine, e.g., a camera device orgeneral purpose computer with or without additional hardware, toimplement all or portions of the above described methods, e.g., in oneor more nodes. Accordingly, among other things, the present invention isdirected to a machine-readable medium including machine executableinstructions for causing or controlling a machine, e.g., processor andassociated hardware, to perform e.g., one or more, or all of the stepsof the above-described method(s).

While described in the context of cameras, at least some of the methodsand apparatus of the present invention are applicable to a wide range ofimage captures systems including tablet and cell phone devices whichsupport or provide image capture functionality.

Images captured by the camera devices described herein may be real worldimages useful for documenting conditions on a construction site, at anaccident and/or for preserving personal information whether beinformation about the condition of a house or vehicle.

Captured images and/or composite images maybe and sometimes aredisplayed on the camera device or sent to a printer for printing as aphoto or permanent document which can be maintained in a file as part ofa personal or business record.

Numerous additional variations on the methods and apparatus of thepresent invention described above will be apparent to those skilled inthe art in view of the above description of the invention. Suchvariations are to be considered within the scope of the invention. Invarious embodiments the camera devices are implemented as digitalcameras, video cameras, notebook computers, personal data assistants(PDAs), or other portable devices including receiver/transmittercircuits and logic and/or routines, for implementing the methods of thepresent invention and/or for transiting captured images or generatedcomposite images to other devices for storage or display.

Numerous additional variations and combinations are possible whileremaining within the scope of the invention. Cameras implemented in someembodiments have optical chains which do not extend out beyond the frontof the camera during use and which are implemented as portable handheldcameras or devices including cameras. Such devices may and in someembodiments do have a relatively flat front with the outermost lens orclear, e.g., (flat glass or plastic) optical chain covering used tocover the aperture at the front of an optical chain being fixed.However, in other embodiments lenses and/or other elements of an opticalchain may, and sometimes do, extend beyond the face of the cameradevice.

In various embodiments the camera devices are implemented as digitalcameras, video cameras, notebook computers, personal data assistants(PDAs), or other portable devices including receiver/transmittercircuits and logic and/or routines, for implementing the methods of thepresent invention and/or for transiting captured images or generatedcomposite images to other devices for storage or display.

Numerous additional embodiments are possible while staying within thescope of the above discussed features.

What is claimed is:
 1. An apparatus for use in a camera device, theapparatus comprising: a filter mount (1106) including sidewalls (1309,1309′, 1306, 1306′) forming a filter well (1110) for mounting a filter(1114), said sidewalls including outer support walls (1309, 1309′)extending from a surface (1103) of a mounting board (1102) to a top(1106′) of said filter well (1110), inner sidewalls (1306, 1306′) ofsaid filter mount (1106) extending inward from the outer support walls(1309, 1309′) to form a support ledge (1111) for supporting the filter(1114) in the filter well (1110).
 2. The apparatus of claim 1, furthercomprising the mounting board (1102) and wherein said filter mount(1106) is positioned on a surface (1103) of said mounting board (1102).3. The apparatus of claim 3, further comprising a filter (1114)positioned in said filter well (1110), said filter (1114), filter mount(1106) and mounting board (1102) forming a cavity (1357) in which asensor (1307) is mounted to said mounting board (1102).
 4. The apparatusof claim 3, wherein said filter well (110) includes rounded notchedcorners (1112, 1112′).
 5. The apparatus of claim 4, wherein the filter(1114) includes rounded corners.
 6. The apparatus of claim 4, whereinthe filter (1114) is secured to the filter mount (1106) in the filterwell (1110) by a drop of glue placed in the corners of the filter well(1110).
 7. The apparatus of claim 6, wherein the filter (1114) is notglued at locations other than the corner locations.
 8. The apparatus ofclaim 2, wherein the inner sidewalls (1306, 1306′) are tapered.
 9. Theapparatus of claim 7, wherein the tapered inner sidewalls extend furtherinward at the top than at the bottom of said sidewalls (1306, 1306′),where the top of said sidewalls corresponds to the side on which thefilter (1114) is mounted and the bottom of said sidewalls corresponds tothe side which extends over the sensor (1307).
 10. The apparatus ofclaim 9, wherein said ledge (1111) extends over wires connecting saidsensor to the mounting board (1102) or a flexible tape (1107).
 11. Theapparatus of claim 2, wherein said filter mount (1106) is a dark color.12. The apparatus of claim 2, wherein said filter mount (1106) has amatt finish.
 13. The apparatus of claim 12, wherein said filter mount(1106) is made of a non-reflective material.
 14. The apparatus of claim2, wherein a top surface of said filter (1114) is recessed below a topsurface of the outer support walls (1309, 1309′).
 15. The apparatus ofclaim 3, wherein at least one corner (1126) of said filter mount (1106)is open for ventilation of the cavity (1357).
 16. The apparatus of claim15 wherein at least one corner (1128) of said filter mount (1106) issealed.
 17. The apparatus of claim 16, wherein multiple corners of thecavity (1157) are sealed.
 18. The apparatus of claim 2, wherein at leastone (1828) of the corners of the filter mount (1106) are stepped.
 19. Acamera module for use in a camera device, the camera module comprising:a filter (1114); a filter mount (1106) including sidewalls (1309, 1309′,1306, 1306′) forming a filter well (1110) for mounting the filter(1114), said sidewalls including outer support walls (1309, 1309′)extending from a surface (1103) of a mounting board (1102) to a top(1106′) of said filter well (1110), inner sidewalls (1306, 1306′) ofsaid filter mount (1106) extending inward from the outer support walls(1309, 1309′) to form a support ledge (1111) for supporting the filter(1114) in the filter well (1110); and a sensor (1307), mounted on saidmounting board (1102) beneath said filter (1114).
 20. The camera moduleof claim 19, further comprising: a flexible circuit tape (1107)connected to said sensor (1307) by wires (901) extending through saidmounting board (1102) to said sensor (1307).